Past performance, peer review and project selection: a case study in the social and behavioral sciences
نویسندگان
چکیده
Does past performance influence success in grant applications? We tested whether the decisions of the Netherlands Research Council for the Economic and Social Sciences correlate with the past performances of applicants in publications and citations, and with the results of the Council’s peer reviews. The Council proves successful in distinguishing grant applicants with above-average from below-average performance, but within the former group there was no correlation between past performance and receiving a grant. When comparing the best-performing researchers who were denied funding with those who received it, the rejected researchers significantly outperformed the funded ones. The best rejected proposals score on average as high on the outcomes of the peer-review process as the accepted proposals. The Council successfully corrected for gender effects during the selection process. We explain why these findings may apply beyond this case. However, if research councils are not able to select the ‘best’ researchers, perhaps they should reconsider their mission. We discuss the role of research councils in the science system in terms of variation, innovation and quality control.
منابع مشابه
Past performance, peer review, and project selection: A case study in the social and behavioral sciences1
Does past performance influence success in grant applications? In this study we test whether the grant allocation decisions of the Netherlands Research Council for the Economic and Social Sciences correlate with the past performances of the applicants in terms of publications and citations, and with the results of the peer review process organized by the Council. We show that the Council is suc...
متن کاملEvaluating the effectiveness of peer-based intervention in managing type I diabetes mellitus among children and adolescents: A systematic review
Background: Type 1 diabetes is one of the chronic metabolic disorders among children and adolescents. Peers are also important units in diabetes management through adolescence. This study aimed to evaluate the effectiveness of peer-based intervention in managing type 1 diabetes mellitus among children and adolescents. Methods: Searching articles published prior to December 2013 in Pub...
متن کاملA stochastic model for project selection and scheduling problem
Resource limitation in zero time may cause to some profitable projects not to be selected in project selection problem, thus simultaneous project portfolio selection and scheduling problem has received significant attention. In this study, budget, investment costs and earnings are considered to be stochastic. The objectives are maximizing net present values of selected projects and minimizing v...
متن کاملTeaching through Near-Peer Method in Medical Education: A Systematic Review
Introduction: Peer education is implemented in various curricula. However, there are conflicting reports of its effects. The aim of this study was to review the literature and assess the outcomes of near-peer education for students of medical sciences. Methods: In this systematic review, an online search was carried out to identify articles published from 1995-2015 on assessing the outcomes o...
متن کاملChildren’s Subjective Well-being; Review on Definitions and Measures
Expended Abstract Introduction: Over the past decades there has been an increasing trend in research towards the children’s subjective well-being (SWB) as an important health and social policy issue. There are many scales for measuring SWB to the extent that selecting an appropriate scale among the available measures could still be regarded as a challenge. Given that measuring subjective well-...
متن کامل